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Abstract 

This paper studies the problem of model-checking of probabilistic automaton and prob¬ 
abilistic one-counter automata against probabilistic branching-time temporal logics (PCTL 
and PCTL*). We show that it is undecidable for these problems. 

We first show, by reducing to emptiness problem of probabilistic automata, that the model¬ 
checking of probabilistic finite automata against branching-time temporal logics are undecid¬ 
able. And then, for each probabilistic automata, by constructing a probabilistic one-counter 
automaton with the same behavior as questioned probabilistic automata the undecidability 
of model-checking problems against branching-time temporal logics are derived, herein. 

Keywords: Probabilistic one-counter automata, probabilistic automata, probabilistic one- 
counter process, Markov decision process, probabilistic branching-time temporal logic, unde¬ 
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1 Introduction 

This paper presents an analysis of model-checking probabilistic branching-time properties of prob¬ 
abilistic automata, in order to study the problem of model-checking probabilistic one-counter au¬ 
tomata against probabilistic branching-time temporal logics. Our starting point is that, as is 
well-known, the class of deterministic one-counter automata is a natural extension of the class 
of finite-state automata [13]. We can also view the class of probabilistic one-counter automata 
as a natural extension of the class of probabilistic automata. Herein, if we can show that the 
questioned problem is undecidable for a restricted one, then the same problem is also undecidable 
for the more general one. But the inverse is false. 

Roughly, probabilistic one-counter automata are probabilistic extension of nondeterministic 
one-counter automata. A nondeterministic one-counter automaton is just a nondeterministic push¬ 
down automaton with one stack symbol Z except the initial stack-bottom symbol Zq which will 
remain static during the computing. The probabilistic behaviors is placed by adding probabilistic 
distribution over the set of nondeterministic choices with which when the corresponding nonde¬ 
terministic one-counter automaton faces. When restricting the input alphabet to contain one 
symbol, probabilistic one-counter automaton will induce a degenerate case which will be called in 
this paper the probabilistic one-counter process. 

Probabilistic automata, since it was introduced by Rabin [L7], has been exhaustively studied 
from the perspectives of automata theory. For instance, the equivalence problem and reduced form 
problem were investigated by Carlyle [9] in 1960s. While its cut-point emptiness problem was first 
shown to be undecidable by Paz in [2] which was reduced indirectly from Post Corresponding 
Problem [6]. On the other hand, probabilistic automata as a kind of simplest probabilistic com¬ 
putation model, there exists few work relates to formal verification, only a paper [16] dealing with 
probabilistic timed automata can be found currently. But we have no idea about whether this 
problem is considered trivial by the community. 

Intuitively, a probabilistic automaton consists of a finite set of states, a finite set of input 
symbols, an initial unit vector, and to each input symbol, a set of driving matrices which are 
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stochastic are related. The stochastic matrix M a for input symbol cr can be interpreted as follows. 
We assume that there are just n distinct states, then for states qi,qj, the probability of the 
transition which is of the form q^ qj, denoted as V(qi —t qj ), is arranged within the (i,j) 
position of M a . In automaton theory, one of the key tasks is to study various properties of 
probability of accepting a finite word w = X\X% ■ • ■ x m for a given probabilistic automaton. 

In the literature on probabilistic formal verification, the formal model for probabilistic discrete 
systems was often depicted by Markov chains [18, 3, 8, 4, 11], which are useful in a number of areas 
including engineering. Recently, many researchers [3, 4, 11] suggested to take advantage of the more 
general case of Markov chains, i.e. Markov decision process, to describe certain more complicated 
formal models with probabilistic behaviors. These points are applicable for probabilistic automata 
and probabilistic one-counter automata. 

As previously stated, Markov chains are wildly used in depicting probabilistic discrete sys¬ 
tems. But unfortunately, it describes only stochastic, but can not describe controlled behaviors 
(nondeterministic choice) which Markov decision process can. Intuitively, Markov decision process 
consists of a countable set of states, a finite set of actions, an initial probabilistic vector t init over 
the set of states, and a probabilistic function to each action a, for a state qi, assigning a value 
V(qi qj) £ [0,1] with ^2 V(qi —t qj) £ {0,1}. In exoteric languages, the dynamics of the 
system begins in an initial state s such that Li n it{s) > 0, then it opts nondeterministically for an 
enabled action a 1 for state s, followed by changing its state to s' with probability V{s s'). 
Note in advance that we will replace the transition s s' by (s, a, s') £ S x Act x S where S is 
the state set and Act is its action set. Then, this kind of procedure will continue infinitely. 

Referring to branching-time temporal logics, we often mean the probabilistic version of 
branching-time temporal logics. In the paper, two various kinds of such logics will be involved, 
i.e., the PCTL and PCTL* which are probabilistic extensions of well-known branching-time CTL 
and CTL* respectively. In such logics, the universal V and existential 3 path quantifiers of CTL 
and CTL* are replaced by probabilistic operator saying that the probability of all runs 

satisfying <p is tx]-related to t, where t £ {>, >}, 1 2 t £ [0,1] is a real and ip is a path formula of 
PCTL or PCTL*. 

We consider the decidability of model-checking probabilistic branching-time properties of such 
models. Specifically, we establish firstly the following result. 

Theorem 1.1. The model-checking problem of probabilistic automata against PCTL (PCTL*) is 
undecidable. 

With the Theorem 1.1 in place, we construct, for each probabilistic finite automaton, a prob¬ 
abilistic one-counter automaton. Herein, we show next the main result 

Theorem 1.2. The model-checking of probabilistic branching-time properties of probabilistic one- 
counter automata is undecidable. 

If let the input alphabet of probabilistic one-counter automata be of only one symbol, this 
special case of probabilistic one-counter automata will be called ‘probabilistic one-counter process’. 
Given a probabilistic one-counter process, it induces a infinite Markov chain. Its model-checking 
problem remains open in this paper, because it seems that the method to Theorem 1.2 is not 
applicable for this case. We conjecture it is decidable, based on that it is not possible to encode 
“Post Corresponding Problem” to its transition rules. 

The remainder of the paper is structured in the following way. In Section 2, we recall some 
necessary definitions. After establishing some necessary technical lemmas, we prove Theorem 1.1 
in Section 3. The proof of Theorem 1.2 is put into Section 4. Finally, we draw some conclusions 
in the last Section. 

1 In this case, it must satisfy T P{s - — r s') = 1, because the action a satisfying T,.., P(s — » s') = 0 is not 
enabled. 

2 Generally, the set of comparison relations is {>, <, =, >, <}, but {>, >} will suffice for our context. 
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2 Definitions 


Throughout the paper, for any set S (finite or infinite), 151 denotes the cardinality of 5, and 
ui denotes either the set (0,1,2, •••}, or |w|, depending on the contexts. E denotes the non¬ 
empty finite alphabet, E* denotes the set of all finite words (including empty word e) over E, 
and E + = E* \ {e}. Let w be a word in E*, then |w| will denote the length of w. For two words 
wi,W 2 £ E*, their conjunction is denoted by W\W 2 - For some information about probability theory, 
the reader is refereed to either [1] or [14, 15], depending on individual preferences. Meanwhile, 
the reader can find useful information about model-checking in [7]. 

Markov Decision Process 

Markov decision processes are probabilistic models which are useful in a number of areas including 
engineering. The one presented here are adapted from [3]. For more details, please consult [3, 5]. 

Definition 2.1. A (discrete) Markov decision process is a tuple Ai = (S,Act, V, tinit) where S is 
a countable set of states, Act a set of actions, V: S x Act x S —> [0,1] the transition probability 
function such that for all s £ S and a £ Act 

'^2'P{s,a,s') £ { 0 , 1 }, 

s'es 

and ti n it : S —> [0,1] is the initial distribution such that X} s eS dnit(s) = 1. An action a £ Act is 
enabled in state s if and only if^2 s > & s V(s,a,8') = l. 

Remark 1. Denote the set of enabled actions in state s by A(s), i.e., 

.A(s) = < a £ Act | V(s, a, s') = 1 

l s'eS 

It is required that |7l(s)| > 0 for any s £ S. When |^4(s)| = 1 for any s £ S, then it is clear that 
an MDP is an Markov chain. 

Definition 2.2. A path in AA = (5, ^4ct, V, iinit) is either a finite or infinite sequence of the form 



depending on whether [«;[ < ui or |w| = u, where w = a\a 2 ■ • ■ a\ w \, Si £ S and at £ Act such that 
V(si,a i+ 1 ,s i+ i) > 0, and ^ V(s i ,a i+1 ,s' i+1 ) = 1 . 

s 'i+ 

Further, we use Paths(s) and IPaths(s) to denote respectively the set of finite paths and in¬ 
finite paths that begin in s. Also, we let Paths(M) = (J S&s Paths(s) and IPaths(M) = 

U se s IPaths ( s )- 

It is convenient to recall the definition of Markov chains. Roughly, Markov chains are proba¬ 
bilistic transition systems which are accepted [3] as the most popular operational model for the 
evaluation of performance and dependability of information-processing systems. For convenience, 
the following definition is re-stated from [18]. 

Definition 2.3. A (discrete) Markov chain is a triple Ai = (S,S,V) where S is a finite or 
countably infinite set of states, 5 C S x S is a transition relation such that for each s £ S there 
exits t £ S such that ( s , t) £ 5, and V is a function from domain S to range (0,1] which to each 
transition ( s,t ) £ S assigns its probability V(s,t) such that t ^ s V(s,t) = 1 for all s £ S. 
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A path in A4 is a finite or infinite sequence of states of S': p = So^i • • ■ such that (s*, Si+i) £ 6 
for each i. A run of Al is an infinite path. We denote the set of all runs in Al by Run , and 
Run(p') to denote the set of all runs starting with a given finite path p'. Let p be a given run, 
then p(i) denotes the state Sj of p, and pi the run s^Si+i • • ■. In this way, it is clear that po = p. 
Further, a state s' is reachable from a state s if there is a finite path starting in s and ending at s '. 

For each s £ S, (Run(s),J-,V) is a probability space, where T is the p-field generated by all 
basic cylinders Run(p) where p is a finite path initiating from s, and V : J- — > [0,1] is the unique 
probability measure such that V{Run{p)) = Ili<i<|p| T(si_ 1 , s*) where p = sosi ■ ■ ■ S| p |. 

Remark 2. Generally, MDPs are not augmented with a unique probability measure because of the 
nondeterminism when choosing an action in A(s). We refer the reader to monograph [3] for some 
more detailed examples. Among many approaches to resolve the nondeterminism of an MDP, the 
usual one is that we can introduce a scheduler. 

Definition 2.4 (Cf. Definition 10.91 [3]). Let At = (S, Act,V, l id ; t ) be an MDP. A scheduler for 
A 4 is a function ©: S + —► Act such that S(soSi • • • s n ) £ A(s n ) for all sqSi ■ ■ ■ s n £ S + . Now we 
can call the path 



a &-path if ai = ©(so • • • Sj_i) for all i > 0. 

Now, we can reason about the probability of sets of ©-paths, because it is clear to see that a 
scheduler © induces a Markov chain. More formally, we have 

Definition 2.5 (Cf. Definition 10.92 [3]). Let Ai = ( S , Act , V, q n it) be an MDP and © a scheduler 
on Ai. The Markov chain Aie induced by & is a tuple 

M 6 = (S+,S,V e ) 

where 8 C S + x S + . For any (w, ws n +i) £ 8 where w = sosi ■ • ■ s n £ S + : 

V 6 {w,ws n+ 1 ) = P(s n ,&{w),s n + 1 ). 

From the above definition, we clearly see that Ale is an infinite Markov chain (Even if the 
MDP Al is finite). In this case, an infinite ©-path is called a ©-run. Further denote the set of 
©-runs that start s by &Runs(s). That is 

&Runs(s ) = {p | p is a ©-path that starts from s} 

Probabilistic Computational Tree Logic 

The logic PCTL 

The logic PCTL, which is slightly different with the one in this paper, was originally introduced by 
Hansson et al. in [8], where the corresponding model-checking problem has been focused mainly 
on finite-state Markov chains. 

Let AP be a fixed set of atomic propositions. Formally, the syntax of PCTL is defined by 

$ ::=p | | $i A $ 2 | Txr(<p) 

ip ::= X<& | 4>iU<I>2 

where 4> and ip denote the state formula and path formula respectively; p £ AP is an atomic 
proposition, cxi£ {>, >}, r is a real with 0 < r < 1. The symbol true is the abbreviation of always 
true. 
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Let A4 = (S, S, V) be a Markov chain and v : AP —>• 2 s an assignment. Then the semantics of 
PCTL, over A4, is given by the following rules 


M, s |=" true 
M,s \= v p 
M, s \= v 

M,s \= v $1 A $ 2 


for any s £ S, 

O s G i/(p), 

O Al,s ^ 

<*=> M, s \= v $i and M,s \= v $2, 

o V({p £ Run(s) : At, p \= v ip}) xi r, 


m,pK x$ 

At,p K $ iU$2 ^ 


M,p( 1 ) K 

3A: > 0.(M,p k \= v $2 a Vj < k.(M,pj \= v $1)). 


The logic PCTL* 

The logic PCTL*, containing PCTL as a sublogic, is a kind of extensions of PCTL. The syntax 
of state formula is the same as for PCTL, while that of path formula is given by 

(p ::= $ | -up | tpi A tfi2 | Xp | pi \3 P2- 

The semantics of PCTL* path formulas are defined, over At, as follows 


M,P K $ 


M,p( 0) K $, 

M,P K ~'<P, 


M,p p 

M,p \= u pi A p 2 


M,p \= v pi and M,p \= u P 2 , 

M,p\="Xp 


M,pi \= v p 

M, p\= u pi\J p2 


3 k > 0.(M,pk \=" $2 A Vj < k.(M,pj \= v $1)) 


where v: AP —» 2 s is an assignment. 


MDPs as Semantic Models of PCTL/PCTL* 

Thus far, we have not mentioned how to specify important properties of finite MDPs by means of 
PCTL/PCTL*, but only given an interpretation of PCTL/PCTL* over a Markov chain. Without 
doubt, to give a rational interpretation of PCTL/PCTL* over an MDP is more complicated due 
to nondeterminism of MDPs, see Remark 2. We quote the common way presented in [3]. 

Let AP be a set of atomic propositions, M = (S, Act, V, q n it) an MDP, and v an assignment 
AP —> 2 s . The way of interpreting PCTL/PCTL* over MDPs is, to some large extent, the same 
as for Markov chains, except the probabilistic operator 7 /xia (p) where <p is a path formula of 
PCTL/PCTL*. The specific approach is given as follows 


M , s \= v true 
M, s\= u p 
M. s j=" 

M,s \=" $1 A $2 


for any s £ S; 

if p £ i/(s); 

«=> M,s <h; 

<t=> M , s \= v $1 and M, s \= v $ 2 ; 


M , s \= v V^ r (p) <*=> V© : Ve({p G &Runs(s) : M , p j=" p}) xi r 

M, binit \= u VmAp) v© : ^2 Re({p G &Runs(s) : M, p \= v p}) xi r 

s: 0 

with that the semantics of path formula is exactly the same as for PCTL/PCTL* interpreted over 
Markov chains. 
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3 Proof of Theorem 1.1 

Probabilistic Automata 

Let us review the standard definition of probabilistic automata, first. 

Definition 3.1 (Adaptation from [17]). A probabilistic automaton (p.a.) over an input alphabet 
X is a d-tuple A = ( Q , {M a \a € X}, w, F) where Q is a finite set of states, M a a stochastic matrix, 
ir, a row vector, is an initial distribution over Q, and F C Q is the accepting set. 

The main behavior of A is that, for each word w = ai <22 • • ■ a n E X*, it induces a word function 
Va{uj), which is given by 


Va(w) = TrM ai M a2 ■ ■ ■ M an r] F 
= 7T M w r] F 

where rjp = (eji) mx i (assuming that |Q| = m) such that ej\ = 1 if qj E F, and ej\ = 0 otherwise. 

Let A, which will be called a cut-point, be an arbitrary real number satisfying that 0 < A < 1, 
we define the languages recognized by A with A in the following ways 

L >X (A) = (weX*| V A (w) > A} 

L> X (A) = {weX*| V A {w) > A}, 

in which the first and second are called the strict and non-strict languages recognized by A 
respectively. With these notions in place, the problems of strict and non-strict emptiness are 
defined to ask whether the sets L >X (A) and L> X (A) respectively are empty or not. Paz showed 
in his book [2] that both problems are undecidable. 

Proposition 3.1. (Adaptation from Theorem 6.17 [2]) Let A = ( Q,{M a \a E X},7r, P) be an 
arbitrary probabilistic automaton, and A: 0 < A < 1 an arbitrary outpoint. Then, it is undecidable 

(1) (strict emptiness.) whether the set {w E X* \ Va(w) > A} is empty; 

(2) (non-strict emptiness.) whether the set {w E X* | Va(w) > A} is empty. 


Now we re-state the definition of probabilistic automata in terms of the langauge of Markov 
decision process. Let A = ( Q , {M a |a E X}, n, F) be a probabilistic automaton. View S = Q and 
Act = X, we can write the stochastic matrix M a as follows 




( Pn 

Pl2 ■ 

’ Plm ^ 


M a 

= 

P21 

P22 

* P2m 




Pml 

Pm2 

Pmm j 


E [0,1] with YJj=iPij = 

1 for all i. 

The intuitive mean 

is that when A is in state 


where pij 

with the input symbol a (The action in the MDP), it changes into state with probability p^. 
Hence the probability function in the MDP can be written as 


V = {M a (i,j)\a £ Act,l <i,j <\S\}- 

Assume next that the input alphabet X = {ai,a 2 ,--- ,a n }, i.e., the Act for an MDP, and n 
corresponds to ti n it ■ Then, a probabilistic automaton A is just an MDP 3 A 1a = (5, Act, V, tinit) 

3 Strictly speaking, A should be considered as an MDP with additional accepting set F. 
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with S = Q, Act = £, V = { M a (i,j ) | a G Act, 1 <i,j < |Sj}, and i; n it = n . It is worth of noting 
that 


for any s G S. 


A(s) = |«G Act | ^2 a, s') = 1 > 

l s'es ) 


= Act (= £) 


3.1 Proof of Theorem 1.1 

We show an important technical lemma, firstly. 

Lemma 3.1. Let A = ( Q, {M a \a G E}, n, F) be a probabilistic automaton, A 4 a = ( S, Act, V, knit) 
an MDP induced by A where S = Q,Act = E, V = {M a {i, j)\a G Act, 1 < i,j < |S|}, and 

Linit = 7r. Further, let Paths(s) be the set of finite &-paths of M. a, given by 


Paths(s) 



&(s 


'i~2 ) 


6(s 


a — l) 


eF 


and 

V e {Paths{s )) = ^2 'P(s,&(s),si)'P(si,&(ssi),s 2 ) • ■ ■ V(s n _i,&(ssi ■ ■ ■ s n _i), s n ) 

p£Paths(s ) 


It can be claimed that, given an arbitrary finite word w = aia 2 ■ • ■ a n G E*, there exists a scheduler 
& w such that 


Va(w) = ^2 knit (s) ■Ve w (Paths(s)) (1) 

ses 

Proof. The desirable scheduler & w is defined inductively as follows. For convenience, we assume 


that Q = m. Given the finite word w = aia 2 

■ ■ ■ a n G £*, 

Tl = 

iinit * AI ai , 

T2 = 

Tl • M a2 ; 

T n = 

Tn —1 • M an 


Then, define 


Suj(si) = ai for any s\ G S with ri(si) > 0; 

©tu(siS 2 ) = a 2 for any s 2 £ S with t 2 (s 2 ) > 0; 

©tu(sosi • • • Si) = Oi+i if ©^(sosi • • • Si- 1 ) is dehned, and for any Si G S with rfisf) > 0 

It is clear that & w is indeed a function from S + to Act, because for any So^i ■ ■ ■ Si G S + , there is 
at most only one element in Act corresponding to ©,„(soSi • • • sf). 

We then need to to show that Eq. (1) is true. To do so, recall the definitions of & w , 

Paths(s) as well as V<s w (Paths(s)). It is clear that the right hand of Eq. (1) is the overall 
probability of finite © m -paths which is of length |w;|, starting from L lnlt then successively ap¬ 
plying actions a±, a 2 , ■ ■ ■ ,a n , finally reaching a state s/ G F. It is just the definition of Pa(w). □ 
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Let V&(Mai t-init V 3 ) further denote the probability that under the schuller 0, all 6- 
runs which start from Li n it, satisfying the path formula ip. Now, we depict an assignment v and 
construct one PCTL formula ip w such that 

Va{w) = Ve w {M a, t-init \= v <Pw) 
for a given finite word w = aia 2 ■ • • a n £ E*. 

Definition 3.2. The assignment v is defined as follows. Let AP = EU {Accept} be the atomic 
propositions. For any s,s' £ S and a € E, if V(s, a, s') > 0 (i.e., the (s, s') index of M a is larger 
than 0), then a £ v(s'). Additionally, v(s) = Accept if s £ F. 

We construct a PCTL formulae which is useful in the later. Given a finite word w = a\ ■ ■ ■ a n £ 
E*. Let <p w be defined inductively as follows. 


Tw 

A_ 

trueU'P >0 (X</j 1 ) 

<Pi 

A_ 

ai A 7 ? >o(X(^ 2 ) 

Pn-2 

A_ 

a n -2 A P> 0 (X^_i) 

Tn— 1 

A_ 

a n -1 AV >0 (X(p n ) 

Tn 

_A 

a n A Accept. 


Lemma 3.2. Let A = ( Q,{M a \a £ T,},tt,F) be a probabilistic automaton and Ma — 
(S, Act, V, Linit) an MDP induced by A. Given an arbitrary finite word w = a\ • ■ • a n £ E*. 
Then we have the following 

^ ^ I'init (S) {Paths (s)) Fq w (Ad APinit ^ Tw) 

sgs 

where v is as in Definition 3.2. 

Proof. We assume the finite 6^-path p of length |u>| is the following 

a± a 2 0,3 a n-1 a n 

p — So - > S 1 - > S2 - > ■ ■ ■ - > s n - 1 - > S n 

It is clear that if Ma,P \= v Tw, then firstly, s n \= v a n A Accept should be stratified by the 
assignment v. Denoting ip n = a n A Accept , as V(s n -i,a n ,s n ) > 0 and s n \= v tp n , this gives 
s n -1 \= v V >0 (X<p n )). Note also that, s„_ 1 \= v a„_i, we get s n _i \= v a„_ 1 A V >0 {X.(p n ). We can 
further denote the formula a n -1 A V>o(Xip n ) by <p n -i- 

Inductively, by the above analysis, we can get that s t |=" cq A'P>o(Xy)j + i) for all 1 < i < n — 1. 
Now, it is clear that s 0 \= v Xi^i if ^(so, ai, Si) > 0, which gives so |=" V > o(X^i). But 
the formula V > o(X.<pi) is not a path formula, rather than a state formula. Recall the semantics 
of s j=" trueU$ (Here, s should be considered as a finite path of length 1). It is clear that 
so 1 = v T>o(X(y5i) is equivalent to so \= v trueLTP^X^i), which is a PCTL formula. It is useful 
to denote trueLrP >0 (X</?i) by tp w . 

It is clear that the probability of all of the G^-paths satisfying ip w , i.e., Ve w {-Ma, Hnit \= v <Pw): 
is just Ysgs L init{s) ■ Ve w {Paths(s)). □ 

We present the proof of the Theorem 1.1 as follows. 

Proof of Theorem 1.1. We show it by contradiction. Assume Theorem 1.1 is false, then for 
any probabilistic automaton A , for any finite word w = aia 2 ■ ■ • a n £ E*, for any p £ [0,1], it is 
decidable that 


M a •> ^init b 1 ' , P> p (ip w ) 
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i.e., it is decidable that 



which includes the case that it is decidable whether or not 



This, by Lemma 3.1 and Lemma 3.2, leads to an algorithm to decide whether Va{w) > p, con¬ 
tracting to the cause 1 of Proposition 3.1. □ 

Remark 3. Note that, the proof of undecidability of model-checking PCTL path formula V> p (<p) 
to probabilistic automata is similar. Note also that PCTL is a sublogic of PCTL*. Hence, Theorem 
1.1 is also true for PCTL*. 

4 Model-checking probabilistic one-counter automata 

Probabilistic one-counter automata 

Let us first recall the standard definition of probabilistic one-counter automata. Note that the 
probabilistic one-counter automata are probabilistic extension of nondeterministic one-counter au¬ 
tomata. Note also that the nondeterministic one-counter automata are nondeterministic extension 
of deterministic one-counter automata, whose description can be found in [10, 13]. 

A probabilistic one-counter automaton R is described by a 8-tuple R = (K, S, T, 6, Zq, S, F , V), 
where 

• K is a nonempty finite set (of states). 

• £ is a nonempty finite set (of inputs). 

• r is a finite nonempty set containing only two stack symbols. 

• 6 is a mapping from K x (£ U {e}) x T into the finite subsets of K x T*. 

• Zq is an element of T, the start stack symbol. 

• q is in K, the set of start states. 

• F is a subset of K , the set of final states. 

• V is a probabilistic distribution from S to range (0,1] stratifying that 



1 if 5(q, a, Z) = {(pi,7i),--- , [puli)} 


A configuration of M is described by (g, n) where q £ K, and n is the number of Z in the 


stack. 


With the standard definition in place, we show the following 

Lemma 4.1. Let A = (Q , {M a \a £ £}, n, F) be any arbitrary probabilistic automaton. Then there 
exists a probabilistic one-counter automaton R such that for any word w £ Y*, the probability of 
accepting w both for A and for R are equal: 


Va{w) = Vr(w). 
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Proof. Construct R = (K, £, T, S, Zq, qo, F', V) as follows. 

First, let K = Q U {go} with assumption that qo ^ Q, and F' = F (of course, the input 
alphabet of A and R are identical). For any s G Q such that 7r(s) > 0 we add the following rule 
into 5: 


(qo, Z 0 ) —4 ( s , Z) with the probability 7r(s) 
Next, we define the remainder of transition rules into S. For any M a , 

(<&,Z)-4(<&,Z) 

is in (5 with V((qi,Z) -4 (q 3 ,Z)) = M a (i,j). It is obvious that 

E z) ^4 (q 3 , z)) = e; M a (i, j ) = i 


The above constructing leads to another ‘probabilistic automaton’ with an additional state 
(qo,Z 0 ). And the matrices are {M', } U {M' a \a € £}, where 


And, rj' F = 


0 

VF 


ML = 


0 7r 

0 / 


Mi = 


0 7T 
0 M„ 


Now, it is obvious that, for any w = a±a 2 ■ ■ ■ a n £ E*, 

V R (w) = (1,0)MXX-M^ 

= ( 1,0 

= 7T M a 
= 'Pa(w), 


( 0 

7T M ai M a2 • 

■■M an \ 

( 0 ^ 

V 0 

M ai 

M a2 ■ • 

■M an J 

V VF ) 

M a2 ' 

■ • M a 

nVF 




as required. □ 

The assignment v described in Definition 3.2 should be modified slightly, i.e., for any configu¬ 
ration ( q,n ), whenever q = q', v(q,n) = v(q',n'). Then the proof of Theorem 1.2, which will be 
omitted here, follows from the above Lemma 4.1 and Theorem 1.1. 

Remark 4. The definition of probabilistic one-counter automata here is different from the one in 
[ 12 ]. Now let |£| = 1, we get a special case of probabilistic one-counter automata, which we name 
it the ‘probabilistic one-counter process’. It is clear that given a probabilistic one-counter process, 
it induces an infinite Markov chain. Hence, the proof method to Theorem 1.2 may not be applicable 
for this case. We conjecture the corresponding model-checking problem is decidable, based on that 
it is difficult to encode “Post Corresponding Problem” to its transition rules. Furthermore, the 
method to its decidability is still lack, which means this problem may be more difficult. 


5 Conclusions 

In this paper, we studied the problems of model-checking probabilistic branching-time properties 
of probabilistic automata and probabilistic one-counter automata. The outcome shows that these 
problems are undecidable. Meanwhile, the model-checking problem of probabilistic one-counter 
process remains open, which is the future work. 
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